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Abstract The classical Haar construction of Brownian motion uses a bi- 
nary tree of triangular wedge-shaped functions. This basis has compactness 
properties which make it especially suited for certain classes of numerical 
algorithms. We present a similar basis for the Ornstein-Uhlenbeck process, 
in which the basis elements approach asymptotically the Haar functions as 
the index increases, and preserve the following properties of the Haar basis: 
all basis elements have compact support on an open interval with dyadic 
rational endpoints; these intervals are nested and become smaller for larger 
indices of the basis element, and for any dyadic rational, only a finite number 
of basis elements is nonzero at that number. Thus the expansion in our basis, 
when evaluated at a dyadic rational, terminates in a finite number of steps. 
We prove the covariance formulae for our expansion and discuss its statistical 
interpretation and connections to asymptotic scale invariance. 

Keywords Ornstein-Uhlenbeck process • Brownian motion • Haar basis 



1 Introduction 

Random walks and continuous stochastic processes are of fundamental im- 
portance in a number of applied areas, including optics [1], chemical physics 
[51 , biophysics [JjT , biology 'F and finance [Sj . The mathematical idealization 
of the one-dimensionnal continuous random walk, the Wiener process, can be 
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expressed in — infinitely — many bases as a sum of random coefficients times 
basis elements. Unique among these bases, the Haar — or Schauder — basis 
has three properties that make it particularly suitable for certain numerical 
computations. First, the basis elements all have compact support the basis 
elements are nonzero only in open intervals. Second, the support is increas- 
ingly compact, i.e., the open intervals become smaller for higher indices of the 
basis elements; in fact, the intervals are nested in binary tree fashion, and 
have dyadic rational endpoints. Finally, given any dyadic rational, there is a 
finite number of basis elements which are nonzero at that number, so that 
evaluation of the Haar expansion at a dyadic rational terminates in a finite 
number of steps known beforehand. These properties can be used to great 
advantage in algorithms that construct the random walk in a "top-down" 
fashion, such as dychotomic search algorithms for first passage times. 
However, the "plain" Wiener process has limited applicability in the ar- 
eas mentioned above, so an extension of this construction to more complex 
stochastic processes is desirable. The naive generalization of the Haar basis 
construction to other stochastic processes fails to display our three properties. 
We present a method for constructing a Haar-like basis for the Ornstein- 
Uhlenbeck process which preserves these properties. The basis is therefore 
useful for advanced numerical computations: a fast dichotomic search al- 
gorithm for first passage time computations shall be presented elsewhere. 
The method we present is also amenable to further generalizations to other 
stochastic processes. 

This paper is organized as follows. We first review some background in 
stochastic processes and basis expansions. Then we review the well-known 
decomposition of a Wiener process in a basis of functions derived from the 
Haar system. In the third section, we give a statistical interpretation of such 
a construction, which leads us to propose a basis for the Ornstein-Uhlenbeck 
process. In the fourth section, we prove that the Ornstein-Uhlenbeck process 
is correctly represented as a discrete process in the proposed basis. In the last 
section, we further the statistical interpretation and its connection to scale 
invariance and Markovian properties. 



2 Background on Stochastic Processes 

The Wiener process and the Ornstein-Uhlenbeck process are continuous stochas- 
tic processes; we specify this class of process through the Langevin equation 

( f{x,t)+i]{t) 
\xito)^xo..te[to,T], 

where / is a deterministic function and ri[t) describes the stochastic forcing. 
Equation ([1]) is a first order stochastic differential equation and its connec- 
tion to the Fokker-Planck equation has been extensively studied [HE]- We 
only consider here the case where the noise is white and Gaussian: 'q{t) are 
realizations of independent identically distributed Gaussian variables rjt, with 
time correlations satisfying 



{?]fVs) = r -sis-t) , 
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where 6 is the Dhae distribution. 

We denote by w a given reahzation of the stochastic forcing: the collection 
of all the values {r]{t)}^^^^^ j,^ in an interval. The set of ui values defines the 
sample space S7 and the probability of occurence of a sequence w in J7 is 
determined by the joint probability of {rit}^^^^^ ^j. With this notation, we 
can introduce the general solution of the stochastic system as the stochastic 
process Xt- For a given realization of the noise w, there is a unique solution to 
(HI) called a sample path: neglecting to notate the dependence on the initial 
condition, we write Xt{Lo) the value of this sample path at time t. Since each 
sample path {Xt{uj)}^^^^^ occurs with the same probability as its match- 
ing sequence oj in the sample space f2, the value Xt{uj) can be seen as the 
outcome of a random function Xt defined on H. Xt is the stochastic process 
solution of ([D) and has several important properties: it is a continuous pro- 
cess as it is defined for a continuous index set [to, T]; it is a Gaussian process, 
as it integrates contributions of Gaussian variables; and, being a Markovian 
process, the value of Xt only depends on {?7(w)}^gjQ jj, the sequence of real- 
izations preceding t. Two special forms of / shall concern us. When / is zero, 
the process is called the Wiener process Wt', when / is linear in x, the process 
is the Ornstein-Uhlenbeck process Ut- Due to the relative simplicity of both 
situations, the probability laws of the processes (i.e., the Green functions of 
the associated Fokker-Planck equations) are known analytically. If a Wiener 
process is at xq at time t = to, the probability of finding the process in x at 
time t is 

P{Wt = x \Wt„ = xo) = exp ( (2) 

with a variance h-ct^ = r-(t — to). For the Ornstein-Uhlenbeck process, a 
similar result holds 

1 / (x~xne-'^'-'^-*°'^)'^\ 
P{Ut=x\Ut„ = Xo) = ^ exp 1 ^ (3) 

with a variance — ^'(l ~ e""'-*"*"^) . The previous expressions describe 
the statistics of Wt and Ut, which will be called Xt when collectively desig- 
nated. Continuous processes require an infinite number of random variables, 
and establishing results about them is quite difficult. Consider for example 
the Ornstein-Uhlenbeck process, widely used from finance to neuroscience: 
finding analytically the first-passage times distribution with a fixed threshold 
proves a surprisingly intricate question in this situation [SICTTU] , and numeri- 
cally, sample paths are only approximated by stochastic Euler methods, with 
integration schema of low efficiency [TT1[T^[T5] . Abating these difficulties for 
the Ornstein-Uhlenbeck process is the motivation for this paper. 
To circumvent the problem, it is advantageous to represent a continuous 
process as a discrete process. Conspicuously enough, a discrete process has 
a countable index set of random variables. At stake is to write a Gaussian 
process Xt as a convergent series of random functions /n-fn, where /„ is a de- 
terministic function and ^„ a Gaussian variable of law Af{0, 1) ( i.e. with null 
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mean and unitary variance ). Assuming the coefficients of the decomposition 
to be included in the definition of /„, the identity 

oo N 

Xt = y2 fn{t) ■ = lim V fn{t) ■ 
n=0 n=0 

shows Xt as the limit of a sequence of finite processes J2n=o fn{t) ■ Cn- De- 
pending on the nature of the convergence, this may result in two advantages. 
Analytically, it is generally more tractable to prove mathematical results on 
finite combination of simple random functions and then to extend them to 
a limit random process. Numerically, the quantity '^^=0 /"(*) ' ^" ^e 
accurately computed and gives a correct approximation of the process at any 
level of precision. 



3 The Haar construction of the Wiener process 

The Haar system is the set of functions hn,k in -^^([0, 1]) defined by 

( if (2fc)2-"<t<(2/c+l)2-" , 

hn,k{t) = \ -2t^ if (2fc+l)2""<i<2(A; + l)2-" , 
l_ otherwise . 

for n > 1 with the addition of the function hofi{t) = 1 on [0, 1]. The Haar 

system has a several interesting properties. First, the functions hn^k form 
a complete orthonormal basis of L^([0, 1]) for the scalar product {f,g) = 
lo fit)9it)dt. Second, each element hn^k has a compact support 

Sn,k=[k-2-"+\{k+l)2-^'] 

and, for a given n, the collection of supports Sn^k represents a partition of 
[0,1]. Third, the functions hn^k build up a wavelet basis of L^([0, 1]), since 
we have the scale-invariant construction rule 

VfcW=2'^-/ii,o(2"-4-A;). (4) 

Such properties prove useful to decompose simple Gaussian process as related 
in the following. Consider the Wiener process Wi as the stochastic integral of 
the independent random variables % which follow a normal law j'V(0, vT'). 
We introduce the associated Gaussian white noise process formally defined 
as on n. A sample path ^^(w) is almost surely an element of L^{[0, 1]) 
for a given noise realization u) = {??(i)}j£[o i]- write its decomposition on 
the Haar basis 

(~^) ^"^^^^ E c„,fe(a;)/i„,fe(t) , 

^ ^ n=0 0<fe<2"-i 
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introducing Cn,k{i^) the component of ^^{lj) in the direction of /i„,fc- Each 
sequence co can yield different coefficients c„.fc(ct;) and their values appear as 
the outcome of a random variable Cn,k defined on the sample space f2 

c„,fc = / h,i^k{t)—j-^dt = / hn,k{t)dWt ■ (5) 
Jo Jo 

In our specific case of Gaussian uncorrelated noise, stochastic integration 
shows that the random variables c„.fc are all independent and identically 
distributed following the law J\f{0, \/T). The white noise process is then 
expressed as a discrete process on i? by 

^ = XI XI ^ ■ ^r,,k{t) ■ in,k , 

n=0 0<fc<2"-i 

where the £^n,k are independent and distributed with law A/'(0, 1). 
The use of Haar functions to decompose white Gaussian noise directly sug- 
gests a corresponding result for the Wiener process. The Wiener process Wt 
is the stochastic integral of the Gaussian white noise process which leads 
to introduce the integrals of hn^k as candidates to build a basis of functions 
for the Wiener process [l4lfT5] . We note this set of integral functions as 

*'„,fc(i) = / X[o.t]{u)hn,k{u) du , (6) 

Jo 

with the help of the indicator functions given by 

, . _(lifO<u<t 
X[o,t]W - jo otherwise 

The first elements of the so-defined basis are shown on figure [1] The question 
is then to know whether the process W^^ defined as the finite sum of random 
functions 

N 

«=0 0<fe<2"-i 

converges toward a Wiener process. It can be shown that the series converges 
normally to a limit process almost surely on fi |141ll5j . Even though we have 
not proven its Wiener process nature yet, we refer to this limit as Wt- Due to 
the normal convergence, Wt is continuous in t and being a sum of Gaussian 
variables, it is a Gaussian process. Therefore, showing that Wt is a Wiener 
process only amounts to demonstrate it has the same law of covariance as a 
Wiener process P^[T5] . i.e. {Wt ■ Wg) = F ■ min {t, s), where min {t, s) is the 
minimum of t and s. In other words, we need to evaluate the quantity 

N 

{Wt ■ Ws) = lim (M^f • W^f ) = lim ^ E '^"■'^■(^) ' *-^(^) 

n^O 0<A:<2"-i 
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Fig. 1 In the left column, the elements of the basis ^„^k are represented for each 
rank n with 0<n<6. In the right column, the partial sums W'^{uj) are shown for 
a given set of realizations lu. Note that each clement 'I'n.k has a compact support 
delimited by dyadic numbers in D„ = {k2~" | 0<fc<2"} and that all ^n'^k is zero 
on Dn for n' > n. 
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which entails the calculation of a rather tedious series. Indeed, for a given 
t, at each step n, there is only one k for which 'Pn,k{t) is nonzero, and ex- 
pressing the series analytically results in a complicated operation. One way 
to overcome the issue is to notice that the expected covariance result can be 
expressed in terms of 

mm(t,s)= X[o,t]{u)X[a.s]{u) du . (7) 

JQ 

The right term of ^ is actually the scalar product of the functions X[o,t] and 
X[o,s] on. L^{[0, 1]). The key point is then to introduce the decomposition in 
the Haar orthonormal basis to write the scalar product of two given functions 
as 

/ f{t)git)dt = X! / f{u)hn,k{u)du g{u)hn,k{u) du . (8) 

When applied to the indicator functions of interest X[o,t\ and X[o.s]i the rela- 
tion ([5]) leads to 

r ■uun{t,s) = r ■ I X[<:).t]{u)X[o,s]{u)du 

JO 

oo 

n=0 0<fe<2"-i 

since the definition ^ describes <fVi,fc(t) as the coefhcient relative to hn,k 
in the decomposition of X[o.t] on the Haar system. We can finally recap the 
result 

{Wt ■ Ws) = hm {W^ ■ W^) 



N 

n=0 0<fe<2"-i 



establishing the discrete description of the Wiener process as a normally 
convergent series of terms ^Pn^k • ^n,k, where ^n,k is a Haar-derived function 
and ^n,k a random variable of normal law Af (0, 1). 



4 Comparison of the Wiener and Ornstein-Uhlenbeck processes 

We recall that the Langevin equation ^ can be solved by quadratures in 
simple cases. If the process is at xq when t = Q, the Ornstein-Uhlenbeck 
process Ut is expressed 

Ut^xoe-°''+ f e"(""*)?7(u)dM, (9) 
Jo 
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as opposed to the Wiener process Wt in the same conditions 



Wt=xa+ / rj{u) du . (10) 





The comparison of definitions ([9|) and (llOp explains why finding a basis of 
decomposition for Ut stumbles on a several difficulties. First the process Ut 
is not anymore a simple integral of white Gaussian noise, which is naturally 
described as a discrete process. Second, there is no more scale invariance, 
implying that a putative basis of decomposition is not to be thought of as 
wavelets. Finally, the exponential factor in ([9]) indicates that the process Ut 
does not sum the rjg evenly; their contribution depends on the position of s 
compared to t. As a consequence, the presence of these correlations makes it 
unlikely for the basis to conserve any orthogonality properties. 
Yet, as noticeable in figure[2l the examination of a sample path {C^t(w)}tg[o i] 
reveals the scale-invariant behavior of a Wiener process for asymptotically 
small time scale as well as for asymptotically small a. It means that the 
basis of decomposition 'Fn.k for the Wiener process is asymptotically valid to 
describe Ut at fine scale. This observation suggests that, upon slight alter- 
ation of its analytical expression, the Haar derived basis 'l'n,k can give rise 
to a basis 'Pn,k adapted to the Ornstein-Uhlenbeck process. The change in 
the analytical expression of ^n,k should be consistent with the previously 
mentioned difficulties, preventing its formulation to be scale invariant or or- 
thogonal. Under this restraint, the fundamental property that each element 
Wn.k exhibits a compact support of the form Sn.k should be preserved in the 
expression of <Pn,k- 

To carry out this program, the key point is to consider P{Xt =y \Xt^=x^ Xt = 
z) with tx < ty < the probability law of Xt knowing its values x and z at 
two framing times tx and t^. Because Xt is a markovian process, a sample 
path {Xt{uj)}f.^^Q ^ which originates from x and joins z through y is just 
the junction of two independent paths: a path originating in x going to y 
and a path originating from y going to z. Assuming conditional knowledge 
of its origin x, the probability of such a compound path is the product of 
the probability of the two elementary paths with conditional knowledge of 
their respective origins x and y. Therefore, after normalization by the ab- 
solute probability for a path to go from x to y, P{Xt^=y \Xt^=x,Xt= z) is 
expressed in the following expression 

PiXt =y\Xt =x,Xt =z) = — ; .(11) 

^ " ^' ' ' ' P{Xt=z\Xt=x) ^ ' 

It is now a simple matter of calculation to compute the distribution of Xt^ 
knowing Xt^ = x and Xt^ = z with the analytical expression of the probability 
P[Xty=y \Xt^=x). In the case of a Gaussian process, it is expected to follow a 
normal law, which we refer to as Af{rl^{ty), p(j{ty)). For the Wiener process, 
using expression ^ for P{Xt^=y\Xt^= x), the mean value wl^ity) and the 
variance wO'{ty)'^ result in 
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Fig. 2 A sample path Ut(io) is represented at different magnifications following 
the scale invariance of a Wiener process: the vertical zooming factor is the square 
root of the horizontal factor. Note that the sample path Ut{io) behaves as a Wiener 
process at small scales. 



\2 p i^y tx){tz ty) . 
wc{ty) = 1 [t ~t) ■ ^ ' 

For the Ornstein-Uhlenbeck process, using expression ^ for 'P{Xt^=y \Xt^= 
x) similarly yields the mean ^^{ty) and the variance ^a{ty)'^: 



sm\\[a{tz — ty)^ sm\i[a{ty — tx)) 

s\\]\i{a{tz-tx)) s\\)h[a{tz-tx)) 



(14) 
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r 2 ■ sinh {a{ty-t^)) ■ sinh {a{t^-ty)) 



In the limit of very short time scale or vanishing a, we notice that ufJ-ity) 
and iju{tyY approximate yy^{ty) and wO'{ty)'^. 

We note Dn the set of reals {k2~'^ | 0< A:< 2^} and we have {0, 1} = C 
-Di C • • • C -Dat a growing sequence of sets with limit ensemble V the set 
of dyadic points in [0, 1]. Assuming we know the values of the process on a 
subset of dyadic points Dat, we can construct the conditional average (-Pt)^)^ , 
which is the most probable outcome of Xt knowing its values on D^- For a 
Wiener process, shows that (Wt)^^ is a piece-wise linear function of t 
interpolating each points of Dn; whereas for an Ornstein-Uhlenbeck process, 
(fT4| depicts {Ut)jj^ as a succession of catenaries joining successive points of 
Dn- With < fc < 2~^, if = ^2"^ and = (fc+l)2-^ are the two successive 
points of Dn framing t, the average {Xt) is only conditioned by Xt^ — x 
and Xt^—z. For the sake of simplicity, we write 

{Xt)^^ = {Xt)^^^^ ^^^t^,tAt,x,z)'^ ,^^^■\t) , (16) 

where the conditional dependency upon x and z is implicit in ^/i^'''. We 
want to investigate the change in the estimation of Pt due to the conditional 
knowledge of its value on the dyadic set Dn+i- In that perspective, we ex- 
emplified the conditional average {Xtjj^^^^ on [ticiz] where the estimation 
of Xt is now dependent upon the value Xt^ — y with ty the midpoint of 
and t,: 



{Xt)^y ift^<t<ty, 

{Xt)y[^ if ty<t<t,, 

'i/ ^,^^^it,y). (17) 

We remark that, being a function of y, the conditional average {Xt)^ y ^ de- 
termines a random function xV^'^{tiYN,k): where the short notation YN^k 
indicates the Gaussian variable Xt^ knowing Xt^ = x and Xt^ = z. The prob- 
ability distribution of Y/v.fe follows the law A/'(xM(^y): xO'(ty)) and it gives, 
through the function xV^''^ , the random contribution of ignoring Xt^ = y 
when one estimates the process knowing its values on tx and tz- 
The results above allows to gain insight in the building of a Wiener process 
Wt as the converging series of random functions ^n,k ■ ^n.k- It is easy to see 
from the definition ^ that ^n.k is linear between any two points in £)„ for 
n < N and that ^n,k is zero on Z)„ for every n > N . In other words, the 
partial sum 

N 

^Y. ^nMt)-^n.k for teDN 

r!=0 0<fc<2"-i 

coincide with Wt on Dn and more generally with {Xt) on [0, 1]. Identifying 
partial sums with conditional averages, it is then straightforward to express 
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the component ^N^i^kit) ■ CN+i,k in the decomposition of Wt 




(18) 



bearing in mind the previous definitions for which [tx, tz] = [k2^^ , (fc + l)2^^] 
is the support Sis[+i,k of^N+i,k- The tight connection between £,N+i.k and Y/v,fe 
is made obvious: if one knows the values of the process on Dn, the random 
contribution of ^N+i,k{t) ■ C-/v+i,fc conveys the uncertainty about Wt that 
is discarded by the knowledge of its values on D^+i \ Dn- 
We are now in a position to complete our program: continuing the identifi- 
cation of partial sums and conditional average for the Ornstein-Uhlenbeck 
process Ut, it is direct to propose a basis of decomposition 



with the adapted definitions of ufi^''' and uV^^^ on SN+i,k, the support of the 
investigated functions <pN+i,k- We underline that the notation Y^^k refers here 
to the random process Ut at the midpoint of the support t = (2fc+l)2~'^^+^^ 
knowing its values on the extremities. 



5 A discrete basis of functions to generate the 
Ornstein-Uhlenbeck process 

In view of representing an Ornstein-Uhlenbeck process as a discrete pro- 
cess, the comparison with a Wiener process suggests a candidate basis of 
decomposition of the form (l>n,k ■ Cn,k, the variable ^n,k following the law 
A/'(0, 1). The deterministic function (l>n,k is defined with support Sn.k = 
[k-2-"+\ (fc-hl)2-"-+i] forn > with < 2fc < 2". We use expressions ([M]) 
and ([15]) to make explicit the formulation of «?„.fe in relation ([19]) and we 
obtain 



'l'N+l,k{t) ■ £.N+l,k 



{t,YN,k)~ut^^-''it) 



(19) 




if (2/c)2-"<i<(2fc+l)2 



V a ^sinh (a2-"+i) 

if (2fc+l)2-"<t<2(fc-|-l)2 




r sinh (a (2 (fc+ 1)2-"- 



(20) 



— n 



^ otherwise . 



Without any further comment, the element <?o,o is defined as 




(21) 
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a choice we will explain in the following section. The first elements '^n,k are 
shown in figure [3l As expected, they are only asymptotically scale-invariant 
but they exhibit the desirable property of being compactly supported on 
Sn,k: the interval between two dyadic points A: -2""+^ and (fc-)-l)2~"+^. 
To validate the decomposition of an Ornstein-Uhlenbeck process Ut on the 
set of functions we need to study the convergence of the partial sums 

N 

n=0 0</c<2i-i 

As each function ([>n.k is dominated by the Haar-derived element ^n,ki the 
normal convergence of the series W^^ {uj) in ([7]) entails the normal convergence 
of {ijj) almost surely on the sample space Q. With anticipation of its 
Ornstein-Uhlenbeck nature, we denote Ut the corresponding limit process. 
The normal convergence causes Ut to be continuous and, being a sum of 
Gaussian variables, a Gaussian process. Therefore, proving that Ut is an 
Ornstein-Uhlenbeck process just requires us to show that the covariance of 
Ut satisfies 

■ ^'^ " £ ■ e""^*"^'^ (e2«(*^'') - l) . (22) 

To establish this relation, we need to evaluate the covariance of Ut as the 
limit covariance of the partial sums 

N 

n=Q 0<fc<2"-i 

It is possible to simplify the above expression, even though the functions 
'l'n,k are not orthogonal. For each given n, the disjoint supports of <Pn,k 
forms a partition of [0, 1] as a collection of segments Sn.k of equal length 
2""+^. Considering a real t, there is only one sequence of indexes fc„ such 
that t belongs to each support of Sn,kn ■ The succession of fc„ represents t 
as the intersection of decreasing dyadic segments n5^o'5'n,fc„, which can be 
explained in terms of the binary representation t = ai2~\ ai G {0, 1}, if 
we exclude inappropriate infinite developments. Bearing in mind the system 
of indexing for Sn.k, a simple recurrence argument leads to the expression of 
kn corresponding to a given t in its binary representation 

n — 1 

fc„ = - • E . (23) 

4=1 

We are now in a position to write the reduced expression of the partial sums 

JV 
n=0 
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Fig. 3 In the left column, the elements of the basis ^n,k are represented for each 
rank n with < n < 6. In the right column, the conditional Ornstein-Uhlenbeck 
process (Ut) is shown for a given set of realizations on Once more, note 

that each element ^n.k has a compact support delimited by dyadic numbers in 
Dn = {fc2"" I 0<A:<2"} and that all <?„/,fc is zero on D„ for n' > n. 
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where the terms ^fe„,„(i) is made exphcit using the previous formulation of 
kn in the definition (|20|) 



r sinh (aX;r+ia»2" 



a ^sinh(a2-"+i) 

T s inh(aE,T+i(l-a0 2- 
^sinh (q:2-«+1) 



if a„= . 



if a„= 1 



Informed by these preUminaries, we shaU carry out the calculation of the 
covariance. The reduced formulation of partial sums allows us to write 



N 



(24) 



where the indexes fc„ and Z„ designate the sequence of functions ^k^.n and 
^;„,n whose supports contain t and s respectively. When t and s are distinct, 
we notice that for n>l— log2 |i — s|, the supports Sk„,n and 5;„^„ containing 
t and s respectively are disjoint, so that the cross-products 'l'k„,n{t)^i„.n{s) 
cancel out if n is large enough. It is then possible to write expression ([24|l as 
a finite sum where the terms ^fc„,n(0 and ?^i„,n(s) are specified due to the 
binary representations t = ^ij" ai2~* and s = &i2~*. We specify that we 
only consider proper binary representations, that is, the binary representation 
of dyadic points is chosen in its finite form. For the sake of simplicity, we 
assume that t < s. Formulated in the binary representation, the order t < s 
is equivalent to the existence of a natural TVq > such that a„ = 6„ as long 



as n < A'o and ojvq < 6jVo; that is aN(, 
remarks, it is clear that Sk n and Si 



■ and 67V0 = 1- With the preceding 
are disjoint for n > Nq and we can 



write the covariance of C/j for > A^o in the explicit form 



r 



N>No 



N„ 

E 



2 • Ur. 



2a \ ^ sinh(a2-"+i) 

\n— 1 ^ ' 



2 sinh (at) sinh (as) V 
sinh a 



The variable u„ apparent in (j25p represents for n < Nq the numerator of the 
cross-products ^k„ ,nit)^i„ .n{s) when the extension a„ and 6„ coincide 

sinh (a aj2"* j sinh (^a J2n+i 

if a„ = &„ , 



sinh (aj:^_^, (l-a,) 2-») sinh (aE^+i (1-^0 



As for the limit case n =No,uno expresses the numerator of the cross-product 
^fe„o ,No (0^i«o .No (s) with qno = and 6jVo = 1 



unq = sinh j a 0^2 ' j sinh j a (1 — 6^) 2 
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At that point, the explicit form of the covariance ([25]) results in a rather 
complicated combination of hyperbolic functions. Fortunately enough, we can 
resort to using remarkable identities to simplify its expression. The solution 
actually lies in the consideration of the quantity 

COO \ / oo \ 

a^a,2-M • sinh | a ^ (l-fe^ 2-*] . (26) 

We show in the supplementary materials that, as long as n<iVo, Vn verifies 
the recurrence relation 

Vn = 2 cosh (a2") • v^+i + Un ■ (27) 

We can express u„ in terms of and f „ + 1 to compute the following series 
by cancellation term by term 

N„-l 

sinh(a2-"+i) sinh(a/2) sinh (a2-^o+i) ' ' 

Remembering that aAr,-, = and b]\[g — 1, we remark that = vno+i =uno 
so that the insertion of ((28)) in expression ([25)1 caused the remaining terms 
in ujvq to cancel out. It is then straightforward to write the covariance 

jN ttN\ _ / 2 • wi _^2sinh(Q!i) sinh (as) \ 



\^^t "-'s /N>No 



sinh(a/2) sinht 



(29) 



We observed that the definition of vi invokes the full binary representations 
of t and s so that we have vi ~ sinh (at) sinh (a (1 — s)). After a several ma- 
nipulations, expression (j29p finally yields 

which is the expected result for the covariance of an Ornstein-Uhlenbeck pro- 
cess given that t— min {t, s) as i < s. 

Regarding the calculation of the variance when t ~ s, the series of cross- 
products 'l'k,^,n{t)^i„,n{s) = "^l^ „(i) becomes infinite, but fortunately the 
recurrence relation (j27p is then valid for every n > 0. As the quantity v„ 
vanishes when n grows to infinity, the cancellation term by term is still effec- 
tive to compute the series in (P5|) . It leads to the expected variance expression 
for an Ornstein-Uhlenbeck process ^af = ^-(1 — e~"*). 
We finally recap the result for any t and s without assuming any order 

{Ut ■ Us) = lim (C/f • C/f ) = ^ ■ e-"(*+^) f e^"^*'^^) - l) . 

N^oo 2a V / 

It proves the discrete description of an Ornstein-Uhlenbeck processes as the 
normally convergent series of random functions 'l>n,k • in,k, where <Pn,k is a 
deterministic function defined in ((6]) and ^n,k a random variable of normal 
law A/" (0,1). 
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6 Representation as a bi-infinite sum of random functions 

Whether standing for a Wiener process or an Ornstein-Uhlenbeck process, 
Xt can be decomposed in a discrete basis of functions fn,k, where fn,k is a 
generic notation for the deterministic functions 'Pn,k and <Pn.k- It suggests to 
consider the process Xt as a recurrence construction, a view that explains 
how to chose the first clement of the basis /o,o- 

Imagine we want to build a sample path of the continuous process Xt starting 
with the prior knowledge of its values on the dyadic set Djv- To proceed at 
the next stage A'' + l, we need to establish the values of Xt on ZJjv+iX-Djv, 
which implies the drawing of as many Gaussian random variables as there 
are points in this set. If we consider a given time t, there exists a unique k 
such that k2~^ <t< (fc+l)2~^ and wc know that the collection of segments 
S'jv+i.fe = [k2-^, (fc + l)2-^] for < /c < 2^ defines a partition of [0, 1]. We 
also remark that tN+i,k = (2fc+ l)2~(-'^+^) is the only point of Z?jv+i\Av 
in SN+i.k and consequently, wc note (N+i.k the Gaussian drawing occurring 
there. According to the results exposed in the second section, we posit 

CiV+l,fe = xCr{tN+l,k) ■ ^N+l,k + xl^{tN+l,k) ■ 

where £,N+i,k is of normal law A/'(0,1). Repeating such a construction for 
n> N + 1 leads us to evaluate the sample path on the whole set of dyadic 
points X>. As P is dense in [0, 1], the complete path is naturally obtained by 
continued extension. 

To construct a process rather than a sample path, we need to formulate the 
above recurrence argument in terms of random functions. We consider the 
conditional average (Xj)^^, which is also the most probable outcome of Xt 
knowing its values on £)jv As is a Markov process, the change in the 
estimation (Xt)^^^^— {Xt) only depends on the outcome of ^N+i,k when 
restricted on the support Sn\-\,k- Due to the simplicity of the situation, it is 
possible to find an analytical expression of the form fN+i,k ■ in,k to describe 
{Xt)jy^^ — (Xt)^^^ on SN+i.k- With the help of the so-defined functions fn,k, 
we can introduce the partial sum 

n=N 

= ^ ^ fn,k{t) ■ in,k 
1=0 0<fc<2'>-i 

and relate it to the conditional average {PtloN considered as a random 
variable. By definition of /jv+i, if coincides with {Xt)j-,^, Pt'^^ equals 
{Xt)j-)^^_^ at next step. Gontinuing this identification for n> N + 1 shows 

that the limit process limjv^oo Pt' agrees with the corresponding Ornstein- 
Uhlembeck process on the index set T). Dealing with continuous processes, 
the density of V in [0, 1] allows us to extent the results on [0, 1]. Incidentally, 
we have an interpretation for the statistical contribution of a component 
fn,k{t) ■ in,k- At each step A'',the function /jv+i,fe(*) • Civ+,fc represents the 
uncertainty about Pt that is discarded by the knowledge of its values on 
Dn+\\Dn- 
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To validate the recurrence argument, it now remains to verify the initial 
statement 

Actually, the need to satisfy this prerequisite enforces how to set the ex- 
pression of /o,o- The conditional average {Xt)jy^ is a function of the value 
of Xt on Dq = {0, 1}. By construction the value of Xt in is assumed to be 
zero. We note Zq^ the random function Xi knowing Xq = 0, and we recall 
that its statistics is given by relations ([2]) for a Wiener process and ([3|) for 
an Ornstein-Uhlenbeck process respectively. With the notation of the second 
section, we write {Xt) j-, as a function of Zo,o 



X 



It defines a Gaussian random function {Xt) of the form /o,o • Co.o- The 
dependency of its variance upon t yields the expression of the deterministic 
part /o,o 

' (30) 



/o,o(<) = \/{{Xt)lj 



When applied to the Wiener process, the above relation gives the right ex- 
pression for !fb,o; when applied to the Ornstein-Ulenbeck process, it gives the 
already mentioned expression of <?o,o- 

Now, we further this recurrence description to show why Xt is naturally 
represented as a bi-infinite series of random functions. In that perspective, 
we extend the definition of the dyadic sets to Djv = {k2~^ | A; G Z} and 
we have D_n = 2^Z C---CDo = Zc---CDn = If we re- 

strain the description of Pt to the index set [0, 1], the argument to set the 
initial step of the recurrence allows us to define a function flp^ q so that 
f*No ' ^-N.o = (^t)z?_iv '^^ [Ojl]- The only requirement to adjust ([50)1 is 
that ]0, 1[ has no points in D-at. The usual recurrence construction is then 
easily adapted to build the process Pt on that segment: for n>—N, the an- 
alytical expressions of /* are simple extensions of the usual formulas fn,k- 
In the case of a Wiener process, we make explicit the functions 'F* ^ 



F 



it ~ 2k- 2- 



2-n+l 

if (2fc)2-"<i<(2/c+l)2- 



if (2A:+l)2-"<i<2(fc + l)2- 

^ otherwise . 
for n> —N, and the first element 5?^*^ q 



(31) 
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In the case of an Ornstein-Uhlenbeck process, we similarly write the functions 



' /r sinh(a(t-2fc-2-")) 



a y/s'mh (q:2-"+1) 
if (2/c)2-"<t<(2fc + l)2-" , 

T sinh(a(2(fc + l)2-"-i)) 



a ^sinh (q!2-"+i) 

if (2fc+l)2-"<t<2(fc + l)2-" 



^ otherwise . 
for n>—N, and the first element ??*^o 



r e 



sinh (at) 



a Vsinh a2 



(32) 



As apparent in ([31]) and ([5^ . the upper bound of /-Ar,o on [0,1] is expo- 
nentially decreasing toward zero when N goes to infinity. The exponential 
uniform convergence of f-N,Q toward zero prescribes to represent the process 
Xt as a bi-infinite series of random functions f^k'^nk 



N 

E 

n=l 





E 



/ji.o(^)^n,0 



In the partial sum X* , the index fc„ refers to the unique functions /* ^ 
whose support contains t for a fixed n. In the case of n < 0, this index is 
constantly set to zero. The two series in X^^ are normally convergent on 
[0, 1]. To verify the cogency of the bi-infinite decomposition, it is enough to 
demonstrate that the covariance of the partial sum 



N 



n=l 



converges toward the expected covariance of the process Xt . This amounts to 
show that the right series in the above expressions equals to /o,o(i) • /o,o(s)- 
In the case of a Wiener process, a direct calculation leads to 





E 

n=-N 



r 



N 

E/ 2"+i 

n=0 



ts ^ r ■ ts 
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which is the exact expression of !Z'n,o(i)'^n,o(s)- In the case of an Ornstein- 
Uhlenbeck process, a similar calculation yields 



K,om:A^) = j:a- sinha2»H.i 

n=-N n=0 ^ ' 



r _^ sinh (at) sinh (as) 
a sinh a 



which consistently equals to <?o,o(i)^^o,o(s)- The previous derivation requires 
the use of the identity 

^ 1 _ e-" 
sinh (q:2" ) sinh a 

proven in the supplementary materials. 

The representation of a Wiener process as a bi-infinite series of random func- 
tions stems from its scale-invariance. During the construction process, the 
values of Wi on D^m+i\Dn only depends upon the previous drawings on D^. 
Initial drawings on the asymptotic bounds of {— oo,0,oo} = lim^v^-oo -Dat 
only produce vanishing correlations for later stage. At any finite step + 1 
in Z, evaluating W* on Dn^i\Dn is a completely scale-invariant operation, 
which justifies a common analytical expression for the elements ^n,k- For 
nonzero coefficient a, the linear component in the Langevin equation pre- 
cludes any scale-invariance for an Ornstcin-Uhlenbeck process Ut- In that 
respect, it is quite remarkable that we can decompose Ut in a basis of func- 
tions ^n,k defined with a unique analytical expression. If n > log2 a the 
functions ^n,k are well approximated by the functions •Z'^^fe showing the typ- 
ical scalc-invariancc of a Wiener process; if n<log2Q: the functions ^n,k are 
exponential attenuation of the functions \I'n,k, with constant extremal value 
\fTj2oL. As is obvious, the parameter a can be interpreted in terms of a 
characteristic time. For time-scales smaller than 2/q!, the components ^n,k 
with intersecting supports add to each others so that the resulting process 
displays the same correlations as a Wiener process. For time-scales larger 
than 2/q!, the components ^n.k add independently because the exponential 
attenuation causes all the components but one to be negligible on intersect- 
ing supports. 

We thank Mariela Sued and Daniel Andor. This work has been supported in 
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